Distance-Based Rendering of Media Files

ABSTRACT

A rendering device is configured to dynamically vary how audio and visual information is rendered by a rendering device responsive to changes in distance between the rendering device and a mobile device carried by a user. As the user moves about, the distance between the rendering device and the mobile device carried by the user will vary. As the distance between the mobile device and the rendering device changes, the rendering system can dynamically adapt how the audio and visual information is rendered. For example, the rendering device can increase or decrease the volume of an audio output, depending on changes in the distance. Also, the rendering device can change how visual information is rendered on a display responsive to changes in distance. In some embodiments, when the distance between the mobile device and rendering device exceeds a predetermined distance, the audio and/or visual information may be sent to the mobile device.

BACKGROUND

In recent years, there has been tremendous growth in the use of smartphones and tablet computers. One reason for the popularity of suchdevices is that they free the user from tethers to fixed communicationnetworks and allow the user to remain in communication with others whilemoving freely about. For example, users can use smart phones and tabletcomputers to send and receive emails, chat with friends, and browse webpages without a fixed connection to communications networks.

Smart phones and tablet computers are commonly used as rendering devicesto play audio and/or videos. Docking systems with built-in speakersand/or displays, or connections to sound and video systems, are nowcommonly used for playing audio and video stored in smart phones andtablet computers. In this scenario, the speakers and/or video screensare likely to be at fixed locations. As the user moves away from thedocking station, attenuation of sound may cause changes in the perceivedvolume. Further, if visual information is output to a display screen onthe smart phone, tablet computer, or docking station, the user's abilityto see the information diminishes as the user moves away from thedocking station.

Accordingly, there is a need for adapting the manner in which audioand/or video is rendered depending on the distance between a user andthe rendering device.

SUMMARY

The present invention provides a method and apparatus for dynamicallyvarying how audio and visual information is rendered by a renderingdevice responsive to changes in a user's location. A rendering device isconfigured to monitor a distance between the rendering device and amobile device that is presumably carried by a user. As the user movesabout, the distance between the rendering device and the mobile devicecarried by the user will vary. As the distance between the mobile deviceand the rendering device changes, the rendering system can dynamicallyadapt how the audio and visual information is rendered. For example, therendering device can increase or decrease the volume of an audio output,depending on changes in the distance. Also, the rendering device canchange how visual information is rendered on a display responsive tochanges in distance. In some embodiments, when the distance between themobile device and rendering device exceeds a predetermined distance, theaudio and/or visual information may be redirected to the mobile device.

Exemplary embodiments of the invention comprise a method implemented atby rendering device for rendering a media file. In one exemplaryembodiment of the method, the rendering device monitors a distancebetween the rendering device and a mobile device while the media file isbeing rendered, and dynamically varies how the media file is renderedresponsive to changes in the distance between the rendering device andthe mobile device.

In some embodiments of the method, the media file comprises audio outputto a speaker associated with the rendering device, and the renderingdevice varies a volume of the audio output by the speaker.

In some embodiments of the method, the media file comprises an image ortext displayed on a display associated with the rendering device, andwherein the rendering device varies the size of the displayed image ortext.

In some embodiments of the method, the media file comprises a stillimage or video image displayed on a display associated with therendering device, and wherein the rendering device varies a zoom levelfor the displayed image.

In some embodiments of the method, the media file comprises a stillimage or video image displayed on a display associated with therendering device, and wherein the rendering device varies a resolutionof the displayed image.

In some embodiments of the method, the media file comprises a web pagedisplayed on a display associated with the rendering device, and whereinthe rendering device varies a page layout for the displayed the webpage.

Some embodiments of the method further comprise outputting audioassociated with the media file to a mobile device when the distance isgreater than a predetermined distance for output by the mobile device.

Some embodiments of the method further comprise outputting an imageassociated with the media file to a mobile device when the distance isgreater than a predetermined distance for output by the mobile device.

Other embodiments of the invention comprise a rendering device forrendering a media file. One embodiment of the rendering device comprisesa distance monitoring circuit for monitoring a distance between therendering device and a mobile device while the media file is beingrendered; and a rendering circuit for dynamically varying how the mediafile is rendered responsive to changes in the distance between therendering device and the mobile device.

In some embodiments, the media file comprises audio output to a speakerassociated with the rendering device, and the rendering circuit isconfigured to vary a volume of the audio output by the speaker.

In some embodiments, the media file comprises an image or text displayedon a display associated with the rendering device, and the renderingcircuit is configured to vary the size of the displayed image or text.

In some embodiments, the media file comprises a still image or videoimage displayed on a display associated with the rendering device, andthe rendering circuit is configured to vary a zoom level for thedisplayed image.

In some embodiments, the media file comprises a still image or videoimage displayed on a display associated with the rendering device, andthe rendering circuit is configured to vary a resolution of thedisplayed image.

In some embodiments, the media file comprises a web page displayed on adisplay associated with the rendering device, and wherein the renderingcircuit is configured to vary a page layout for the displayed web page.

In some embodiments, the rendering device further comprises a wirelesstransceiver for sending audio associated with the media file to aspeaker on the mobile device when the distance is greater than apredetermined distance.

In some embodiments, the rendering device further comprises a wirelesstransceiver for sending an image associated with the media file to adisplay on the mobile device when the distance is greater than apredetermined distance.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates a rendering system including a rendering device forrendering media files and mobile device carried by a user.

FIG. 2 illustrates an exemplary method implemented by the renderingsystem for varying how a media file is rendered based on a distancebetween a rendering device and a mobile device.

FIG. 3 illustrates an exemplary rendering device for the renderingsystem.

DETAILED DESCRIPTION

FIG. 1 illustrates a rendering system 10 according to one exemplaryembodiment of the invention. The rendering system 10 comprises four mainelements: a rendering device 100, a docking station 200 for therendering device 100, a mobile device 300 that is carried by a user, anda positioning device 400 for determining a position of the mobile device300. It is presumed that the mobile device 300 is carried by the user sothat the position of the mobile device 300 is the same as the user'sposition.

The rendering device 100 in the exemplary embodiment comprises a mobiledevice, such as smart phone, personal digital assistant, tabletcomputer, or laptop computer. Such devices typically include built-inspeakers for outputting sound and a display for outputting visualinformation. The rendering device 100 may be used, for example, to playback audio and/or video files. As an example, the rendering device 100may be used to play back music files stored in the memory of therendering device 100. At the same time, album art and song informationmay be output to the display. In the exemplary embodiment, the renderingdevice 100 may be docked with a docking station 200. In this case, therendering device 100 may output audio signals or images to the dockingstation 200.

The docking station 200 comprises a dock with a system connector forconnecting to the rendering device 100, and speakers for outputtingaudio. The docking station may also optionally include a display foroutputting visual information (e.g. images and text). The systemconnector enables the rendering device 100 to output audio and/or videosignals to the docking station. The system connector also enables theexchange of control signals between the docking station and mobiledevice. In some embodiments, the docking station 200 may connect to homestereo or video systems, thus allowing audio and video files stored inthe rendering device 100 to be played back via the home stereo and/orvideo system.

The mobile device 300 comprises a handheld wireless communicationdevice, such as a cell phone, smart phone, or personal digitalassistant. Such devices are typically carried on a person or kept closeat hand. Therefore, embodiments of the present invention presume thatthe user's location is the same as the mobile device location.

The positioning device 400 monitors the current location or position ofthe mobile device 300 and determines a distance between the mobiledevice 300 and rendering device 100. In the embodiment shown in FIG. 1,the positioning device 400 is separate from the rendering device 100. Inother embodiments, the positioning device 400 could be integrated withthe rendering device 100 or the mobile device 300.

A variety of technologies exist for determining the position of a mobiledevice 300 in an indoor environment. For example, where the mobiledevice 300 is equipped with a WiFi transceiver or Bluetooth transceiver,distance to the mobile device 300 can be estimated based on receivedsignal strength (RSS) measurements. These techniques are particularlyuseful where the positioning device 400 is integrated or co-located withthe rendering device 100 or docking system 200.

In scenarios where multiple WiFi or Bluetooth nodes are present,triangulation techniques can be used to determine a position of themobile device 300 and/or the rendering device 100. For example, themobile device 300 can transmit a signal that is received at multipleWiFi or Bluetooth nodes. Assuming synchronization between the receivingnodes, the time difference of arrival of the signal at each of the nodescan be used to determine the position of the mobile device 300. The sametechnique can be used to determine a position of the rendering device100. Once the positions of the mobile device 300 and rendering device100 are known, a distance between the two devices can be determined.

In other embodiments of the invention, the positioning device 400 can beintegrated with the mobile device 300. Location fingerprintingtechniques can be used to determine a location of the mobile device 300in two dimensions. Again, assuming the position of the rendering device100 is known, the distance between the mobile device 300 and renderingdevice 100 can be determined from the position of the mobile device 300.

Because positioning techniques are well known in the art, thesetechniques are not described in detail. Further, those skilled in theart will appreciate that the particular techniques for determiningdistance between the mobile device 300 and rendering device 100 are nota material aspect of the invention. Any positioning techniques now knownor later developed may be used in practicing the invention describedherein.

In operation, the positioning device 400 provides position or distanceinformation to the rendering device 100. The processor 110 in therendering device continually monitors the distance between the mobiledevice 300 and the rendering device 100. Depending on the distance, therendering device 100 can dynamically adapt how a media file is rendered.When the media file includes audio, the rendering device 100 can varythe volume of the audio depending on the distance between the mobiledevice 300 and rendering device 100 to provide a normalized volumedepending on the distance. For example, the volume can be increased ordecreased responsive to changes in the distance between the mobiledevice 300 and rendering device 100. When the media file includes visualinformation output to a display on the rendering device 100 or dockingstation 200, the rendering device 100 can adapt the way in which visualinformation is rendered. For example, the size of images and text can beenlarged or decreased as a function of the distance between the mobiledevice 300 and rendering device 100. Also, the layout of visualinformation may be changed to accommodate long-distance viewing.

In some embodiments of the invention, the rendering device 100 may sendaudio or images to the mobile device 300 when the distance between themobile device 300 and the rendering device 100 exceeds a predetermineddistance, e.g., 15 feet. For example, the audio signals may be sent fromthe rendering device 100 to the mobile device 300 when the mobile device300 is more than a predetermined distance away from the rendering device100. In this case, the audio can then be rendered on the mobile device300. As the user moves back in range, the rendering device 100 mayswitch the audio output back to the docking station.

Similarly, images can be transferred via a wireless interface to themobile device 300 when the mobile device 300 begins to move out of rangeof the rendering device 100 so that the images can be displayed to theuser on a display of the mobile device 300. In this case, the displayscreen of the rendering device 100 may be turned off in order toconserve power. As the mobile device 300 moves back in range, therendering device 100 stops sending images to the mobile device 300 andoutputs the images to the display of the rendering device 100.

FIG. 2 illustrates an exemplary method according to one embodiment ofthe invention. The method begins when the rendering device 100 startsrendering a media file, e.g. music or video. While the media file isbeing rendered by the rendering device 100, the rendering device 100monitors the distance between the rendering device 100 and the mobiledevice 300 (block 510). As previously indicated, the positioning device400 may provide the rendering device 100 with the current position ofthe mobile device 300. The rendering device 100 could then compute thedistance to the mobile device 300 based on the position information.Alternatively, the positioning device 400 may compute the distancebetween the rendering device 100 and mobile device 300, and report thecomputed distance to the rendering device 100. In either case, theperiodic distance measurements are used by the rendering device 100 todetect changes in the distance between the rendering device 100 and themobile device 300.

In one exemplary embodiment, the rendering device 100 compares the mostrecent distance measurement to a predetermined distance threshold (block520). When the distance reaches the threshold, the rendering device mayredirect the output to the mobile device 300 (block 530). For example,the audio signals may be sent from the rendering device 100 to themobile device 300 when the mobile device 300 is more than apredetermined distance away from the rendering device 100. In this case,the audio can then be rendered on the mobile device 300. As the usermoves back in range, the rendering device 100 may switch the audiooutput back to the docking station (block 540).

Similarly, images can be transferred via a wireless interface to themobile device 300 when the mobile device begins to move out of range ofthe rendering device 100 so that the images can be displayed to the useron a display of the mobile device 300 (block 530). In this case, thedisplay screen of the rendering device 100 may be turned off in order toconserve power. As the mobile device 300 moves back in range, therendering device 100 stops sending images to the mobile device 300 andoutputs the images to the display of the rendering device 100 (block540).

Those skilled in the art will appreciate that the operation representedby blocks 520-540 are optional and do not need to be performed in allembodiments.

As the distance between the mobile device 300 and rendering device 100changes, the rendering device 100 dynamically varies how the media fileis rendered (block 550). For example, if the media file includes audio,the rendering device 100 may vary the volume of the audio. If the mediafiles include still images or video images output to a display, therendering device 100 may vary the size of the image or accompanying textbeing displayed. Also, the rendering device 100 could vary the zoomlevel or resolution of the displayed image. This process repeats untilthe playback of the media file is stopped.

In some embodiments, the media file may comprise web content displayedon a display associated with the rendering device 100. The renderingdevice 100 may, as previously described, vary the size of text, images,or other visual content contained within the web page. Additionally, therendering device could also change the layout of visual contentdisplayed on a display depending on the distance.

FIG. 3 illustrates the main functional elements of the rendering device100. As previously noted, the rendering device 100 may comprise a smartphone, tablet computer, or other mobile device. The rendering device 100comprises a processing circuit 110, memory 120, a user interface 130, awireless transceiver 140, audio circuits 150, microphone 160 and speaker170.

The processing circuit 110 controls the overall operation of therendering device 100 according to programs stored in memory 120. Thecontrol functions may be implemented in one or more microprocessors,hardware, firmware, or a combination thereof. The processing circuit 110includes a distance monitoring circuit 112 and a rendering circuit 114.The distance monitoring circuit 112 monitors the distance to the mobiledevice 300 and detects changes in the distance between the renderingdevice 100 and the mobile device 300. The rendering circuit 114 controlshow the media files are rendered based on the distance. As previouslynoted, the rendering circuit 114 may adjust the volume of audio filesare alter the way in which visual information is output.

Memory 120 may include both random access memory (RAM) and read-onlymemory (ROM). Memory 120 stores program instructions 122 and datarequired for operation. Memory 120 also stores media files 124 to berendered by the rendering device 100. Computer program instructions andmedia files are preferably stored in non-volatile memory, such as EPROM,EEPROM, and/or Flash memory, which may be implemented as discretedevices, stacked devices, or integrated with processor 110.

The user interface 130 includes one or more user input devices 132 and adisplay 134 to enable the user to interact with and control therendering device 100. The user input devices 132 may include a keypad,touchpad, joystick control, dials, control buttons, or a combinationthereof. Information for viewing by the user can be output to thedisplay 134. The display 134 may comprise a touch screen display, whichalso functions as an input device 132.

Communication interface 140 comprises one or more wireless transceiversto enable the rendering device 140 to communicate with remote devices.In the exemplary embodiment, the communication interface includes acellular transceiver, which may operate according to any known standard,including the Global System for Mobile Communications (GSM), WidebandCDMA (WCDMA), and Long Term Evolution (LTE). The communication interface140 further includes a short-range wireless interface, such as aBLUETOOTH or WiFi interface, to enable the rendering device 100 tocommunicate over a wireless channel with the mobile device 300 or othernearby devices. For example, the short-range wireless interface can beused to send media files to the mobile device 300 when the mobile device300 moves away from the rendering device.

Audio circuits 150 receive analog audio inputs from microphone 160 andprovide basic analog output signals to speaker 170. Microphone 160converts the detected speech and other audible signals into electricalaudio signals and speaker 170 converts analog audio signals into audiblesignals that can be heard by the user. The audio circuits can alsoswitch the audio output between the built-in speaker 170 and the systemconnector 180.

The system connector 180 provides an interface for connecting therendering device 100 with the docking station 200 or charging station(not shown). The system connector 180 provides electrical connectionsbetween the rendering device 100 and the docking station 200 so thataudio files and or video files can be output to the docking station 200.The system connector 180 may also provide signaling connections betweenthe rendering device 100 and the docking station 200 for controlsignaling.

As previously indicated, the mobile device 300 may comprise a smartphone, cell phone, personal digital assistant, or other mobile devicewith wireless communications capabilities. Such devices are well-knownin the art and are therefore not described herein in detail. It is notedthat such device typically include a short-range interface (e.g. WiFi orBLUETOOTH) 310 so that the location of the mobile device 300 can bedetermined. The wireless interface may be used to communicate with therendering device 100 and/or positioning device 400. Such devices alsohave a display 320 and speakers 330 capable of rendering media files.Therefore, when the mobile device 300 moves beyond a predeterminedrange, the media files can be sent to the mobile device 300 by therendering device via the short-range interface. Thus, the mobile device300 may serve as an auxiliary rendering device.

The present invention may, of course, be carried out in other specificways than those herein set forth without departing from the scope andessential characteristics of the invention. The present embodiments are,therefore, to be considered in all respects as illustrative and notrestrictive, and all changes coming within the meaning and equivalencyrange of the appended claims are intended to be embraced therein.

What is claimed is:
 1. A method implemented of rendering a media file,said method comprising: monitoring a distance between the renderingdevice and a mobile device while the media file is being rendered; anddynamically varying how the media file is rendered responsive to changesin the distance between the rendering device and the mobile device. 2.The method of claim 1 wherein the media file comprises audio output to aspeaker associated with the rendering device, and wherein varying howthe media file is rendered comprises varying a volume of the audiooutput by the speaker.
 3. The method of claim 1 wherein the media filecomprises an image or text displayed on a display associated with therendering device, and wherein varying how the media file is renderedcomprises varying the size of the displayed image or text.
 4. The methodof claim 1 wherein the media file comprises a still image or video imagedisplayed on a display associated with the rendering device, and whereinvarying how the media file is rendered comprises varying a zoom levelfor the displayed image.
 5. The method of claim 1 wherein the media filecomprises a still image or video image displayed on a display associatedwith the rendering device, and wherein varying how the media file isrendered comprises varying a resolution of the displayed image.
 6. Themethod of claim 1 wherein the media file comprises a web page displayedon a display associated with the rendering device, and wherein varyinghow the media file is rendered comprises varying a page layout for thedisplayed the web page.
 7. The method of claim 1 further comprisingoutputting audio associated with the media file to a speaker on themobile device when the distance is greater than a predetermineddistance.
 8. The method of claim 1 further comprising outputting animage associated with the media file to a display on the mobile devicewhen the distance is greater than a predetermined distance.
 9. Arendering device for rendering a media file, said device comprising: adistance monitoring circuit for monitoring a distance between therendering device and a mobile device while the media file is beingrendered; and a rendering circuit for dynamically varying how the mediafile is rendered responsive to changes in the distance between therendering device and the mobile device.
 10. The rendering device ofclaim 9 wherein the media file comprises audio output to a speakerassociated with the rendering device, and wherein the rendering circuitis configured to vary a volume of the audio output by the speaker. 11.The rendering device of claim 9 wherein the media file comprises animage or text displayed on a display associated with the renderingdevice, and wherein the rendering circuit is configured to vary the sizeof the displayed image or text.
 12. The rendering device of claim 9wherein the media file comprises a still image or video image displayedon a display associated with the rendering device, and wherein therendering circuit is configured to vary a zoom level for the displayedimage.
 13. The rendering device of claim 9 wherein the media filecomprises a still image or video image displayed on a display associatedwith the rendering device, and wherein the rendering circuit isconfigured to vary a resolution of the displayed image.
 14. Therendering device of claim 9 wherein the media file comprises a web pagedisplayed on a display associated with the rendering device, and whereinthe rendering circuit is configured to vary a page layout for thedisplayed web page.
 15. The rendering device of claim 9 furthercomprising a wireless transceiver, wherein the rendering circuit isconfigured to output audio associated with the media file to the mobiledevice when the distance is greater than a predetermined distance foroutput by the mobile device.
 16. The rendering device of claim 9 furthercomprising a wireless transceiver, wherein the rendering circuit isconfigured to output the image associated with the media file to themobile device when the distance is greater than a predetermined distancefor output on a display of the mobile device.